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Abstract — This paper presents a novel adaptive reduced- 
rank multl-lnput-multl-output (MIMO) decision feedback 
equalization structure based on joint Iterative optimization 
of adaptive estimators. The novel reduced-rank equalization 
structure consists of a joint Iterative optimization of two 
equalization stages, namely, a projection matrix that performs 
dimensionality reduction and a reduced-rank estimator that 
retrieves the desired transmitted symbol. The proposed reduced- 
rank structure Is followed by a decision feedback scheme that Is 
responsible for cancelling the Inter-antenna Interference caused 
by the associated data streams. We describe least squares (LS) 
expressions for the design of the projection matrix and the 
reduced-rank estimator along with computationally efficient 
recursive least squares (RLS) adaptive estimation algorithms. 
Simulations for a MIMO equalization application show that the 
proposed scheme outperforms the state-of-the-art reduced-rank 
and the conventional estimation algorithms at about the same 
complexity. 

Index Terms — MIMO systems, equalization, parameter estima- 
tion, reduced-rank schemes. 

I. Introduction 

The high demand for performance and capacity in wireless 
networks has led to the development of numerous signal 
processing and communications techniques for employing the 
resources efficiently. Recent results on information theory have 
shown that it is possible to achieve high spectral efficiency [JJ 
and to make wireless links more reliable ||2], (|3] through 
the deployment of multiple antennas at both transmitter and 
receiver In MIMO communications systems, the received 
signal is composed by the sum of several transmitted signals 
which share the propagation environment and are subject to 
multiple propagation paths and noise at the receiver The 
multipath channel originates intersymbol interference (ISI), 
whereas the non-orthogonality among the signals transmitted 
gives rise to multi-access interference (MAI) at the receiver 

In order to mitigate the detrimental effects of ISI and 
MAI, that reduce the performance and the capacity of MIMO 
systems, the designer has to construct a space-time and 
MIMO equalizer The optimal MIMO equalizer known as 
the maximum likelihood sequence estimation (MLSE) re- 
ceiver was originally developed in the context of multiuser 
detection in |4|. However, the exponential complexity of the 
optimal MIMO equalizer makes its implementation costly 



for multipath channels with severe ISI and MIMO systems 
with many antennas. In practice, designers often prefer the 
deployment of low-complexity MIMO receivers such as the 
linear [5|, |6| and MIMO decision feedback equalizers (DFE) 
Q, lEl. Among these, the DFE Q, Hj can offer substan- 
tially better performance than their linear counterparts due 
to the interference cancellation capabilities of the feedback 
section for good channel conditions. These receivers require 
the estimation of the coefficients used for combining the 
received data and extracting the desired transmitted symbols. A 
challenging problem which remains unsolved by conventional 
estimation techniques is that when the number of elements 
in the estimator is large, the algorithm requires substantial 
training for the MIMO DFE and a large number of received 
symbols to reach its steady-state behavior 

Reduced-rank estimation |17|-|22| is a very powerful 
and effective technique in low-sample-support situations and 
in problems with high-order estimators. The advantages of 
reduced-rank estimators are their faster convergence speed 
and better tracking performance than existing techniques 
when dealing with large number of weights. Several reduced- 
rank methods and systems have been proposed in the last 
several years, namely, eigen-decomposition techniques ifTSl . 
the multistage Wiener filter (MWF) |19|, and the auxiliary 
vector filtering (AVE) algorithm 121]. Prior work on reduced - 
rank estimators for MIMO systems is extremely limited and 
relatively unexplored, being the work of Sun et al. [281 one 
of the few existing ones in the area. 

In this work, we propose a novel adaptive MIMO decision 
feedback equalization structure based on a novel reduced-rank 
estimation method. The proposed reduced-rank equalization 
structure consists of a joint iterative optimization of two 
equalization stages, namely, a projection matrix that performs 
dimensionality reduction and a reduced-rank estimator that 
retrieves the desired transmitted symbol and is then followed 
by a feedback section that is responsible for cancelling the 
multi-access interference caused by the associated users. The 
essence of the proposed scheme is to change the role of the 
equalization filters of the feedforward section of the MIMO 
DFE. The projection matrix is responsible for performing 
dimensionality reduction, whereas the reduced-rank estimator 
effectively retrieves the desired signal. In order to estimate 



the coefficients of the proposed MIMO reduced-rank DFE, we 
describe least squares (LS) expressions for the design of the 
projection matrix and the reduced-rank estimator along with 
computationally efficient recursive least squares (RLS) adap- 
tive estimation algorithms. The performance of the proposed 
adaptive MIMO reduced-rank DFE and estimation algorithm 
is assessed and compared with the best known estimation 
schemes via numerical simulations. 

The rest of this paper is structured as follows: The MIMO 
system model is given in Section II. The conventional adaptive 
MIMO DFE is reviewed in Section III, whereas the proposed 
adaptive MIMO reduced-rank DFE is introduced in Section IV. 
Section V is devoted to the development of the LS estimators 
and the computationally efficient RLS algorithms. Section VI 
presents and discusses the simulation results and Section VII 
gives the concluding remarks of this work. 

II. MIMO System Model 

Consider a MIMO system with Nt antennas at the transmit- 
ter and Nn antennas at the receiver in a spatial multiplexing 
configuration, as shown in Fig. [T] The signals are transmitted 
from Nt antennas over multipath channels with Lp propaga- 
tion paths and are received by Nb, antennas. We assume that 
the channel is constant during each packet transmission and 
the receiver is synchronized with the main path. 
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Fig. 1. MIMO system model. 

The received signals are filtered by a matched filter, sampled 
at symbol rate, organized in a window of L symbols {L > Lp) 
for each antenna element and yield the LN^i x 1 received 
vector 

y[i] =H[i]xTH+n[i], (1) 

where y[i] = [yf [«] yl^i*] ••• Vn [*]] contains the signals 
collected by the Nt^ antennas, the L x 1 vector yk\i] = 
[yfc.iW VkA^ •■• yfc,iW] , for fc = l, ..., Nr, contains 
the signals collected by the fcth antenna and are organized 
into a vector. The LNji x LNt MIMO channel matrix H[i] 
is described by 
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, (2) 



where the LxL matrix ilk,j [i] describes the multipath channel 
from antenna k to antenna j. The LNt x 1 vector XT[i] — 
[x|"[i] x|"[i] . . . x^ [i]\ is composed by the data symbols 
transmitted from the Nt antennas at the transmitter with x^ [i] 
being the ith transmitted block with dimensions L x 1. The 
LiV/j X 1 vector n[i] is a complex Gaussian noise vector with 
zero mean and i?[n[z]n-^[i]] — cr^I, where (•)-^ and {■)^ 
denote transpose and Hermitian transpose, respectively, and 
E[-] stands for expected value. 

III. Adaptive MIMO Decision Feedback Equalizer 
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Fig. 2. MIMO system model with conventional decision feedback equalizer. 

The conventional MIMO decision feedback equalizer de- 
sign corresponds to determining an LNji x Nt estimator 
W[i] = [wi[z]w2[i] . . . wjvr[i]] that linearly combines the 
received signal y[i] and an Nt x Nt estimator F[i] = 
[fi[i] f2[?] . . . fAry[«]] that cancel the associated MAI created 
by the different data streams and the ISI caused by the multi- 
path channels. The block diagram shown in Fig. 2 illustrates 
how the MIMO DFE works. The estimate z[i] of the desired 
symbols is given by 
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where x[i] — Q (W^ [*]y [*]) is the initial decision vector taken 
with the feedforward section W[i] and Q{ ■ ) represents a 
decision device. For the design of the feedback section, we 
constrain F[i] to be full and to have zeros along the diagonal 
to avoid cancelling the desired symbols. This corresponds to 
parallel decision feedback ll28l . ||29l . Specifically, the non- 
zero part of the filter F[i] corresponds to the number of used 
feedback connections and to the users to be cancelled. The 
feedback connections used and their associated number of non- 
zero filter coefficients in F[i] are equal to Nt — 1 for all users. 
The detected symbols of the DFE after the interference 
cancellation x*^-''''[i] carried out by the feedback section are 
given by 
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(4) 



In order to design the LA'^/j-dimensional estimators Wj[i] 
(j = 1, . . . , Nt) that form W[i], one can resort to stochastic 
gradient or LS algorithms, as in [6|, |7|, [S]. 

IV. Proposed Adaptive MIMO Reduced-Rank 
Decision Feedback Equalizer 

In the proposed reduced-rank linear MIMO equalizer, the 
signal processing tasks are carried out in two stages, as 
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Fig. 3. Proposed MIMO reduced-rank decision feedback equalizer 



S_Dj[J], Wj[«], and ij[i] of the proposed MIMO reduced- 
rank DFE and a computationally efficient RLS algorithm for 
implementing the proposed LS estimator. 

A. Least Squares Design 

In order to design Sdj[z], Wj[z], and ij[i], we describe 
a joint iterative LS optimization algorithm. Let us consider 
the exponentially-weighted LS expressions for the estimators 
Sd.j [i] , Wj [i], and ij [i] can be computed via the cost function 



illustrated in Fig. 3. Firstly, we consider the dimensionality 
reduction of y[i] by projecting the received vector onto a lower 
dimensional subspace. Specifically, consider an LN^ x D 
projection matrix S£)j[«] which carries out a dimensionality 
reduction on the received data for extracting the symbols 
transmitted from antenna j as given by 
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where, in what follows, all D-dimensional quantities are 
denoted with a "bar". The resulting projected received vector 
yj[i] is the input to an estimator represented by the D x 1 

i]]'^ for time interval 



vector Wj [i\ ~ [w - ^ [i\ w - 2 [«J 
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i. The reduced-rank estimator output corresponding to the 
ith time instant and estimators Wj[«], S£).j[i], and {j[i] for 
extracting the symbol transmitted from antenna j is 



W=wfWSg,^.[z]y[z]-ffWiH 



wfWyK 



(6) 

where the feedback section estimators form F[«] = 
[fi[i] ... fAry[i]], which is constrained to have zeros along 
the main diagonal to avoid cancelling the desired symbols, 
similarly to the conventional MIMO DFE. We will con- 
sider here the case where the number of transmit antennas 
Nt is reasonably small which leads to small estimators 
in F[i]. From the above outputs, we construct the vector 

z[j] = [zi [i] . . . Zj [i] . . . zjvt W] ■ The detected symbols of 
the proposed reduced-rank MIMO DFE after the interference 
cancellation x'-^Hil are obtained with 
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(7) 



We remark that when Nt becomes large and consequently 
the number of used feedback connections corresponding to 
the data streams to be cancelled, the designer can incorporate 



this in a single large matrix filter C 



W^filF^ 



\c^{i\ ■ ■ ■ cjj ] and stack the vectors y[i] and x.[i], forming 
the {LNr + N + T) X 1 vector a^[i] = [y'^[i] x^[i]]. In 
this case, the output of the MIMO DFE would be Zj[i] = 
c^[i]S^ [i]a[i], where S^ ^ [i] is a modified projection matrix 
with dimensions {LNr + N + T) x D. 

V. Proposed Least Squares Design and 
Reduced-Rank RLS Algorithms 

In this section, we present a joint iterative exponentially 
weighted least squares (LS) estimator design of the parameters 
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where A is the forgetting factor 

By minimizing (8) with respect to Sd,j[ 



ff[z]x[. 



we obtain 
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(5) where Pd.A^ = ELi A^"'2;*mymwf [z], R^ = 

ELi A^-'y[?]y^[?], Pf.M = EUy-'y[i]^fm"[i], and 



R-tojH = E/=i '^^ ™j[^]w^[?]. By minimizing (8) with 
respect to Wj[z], the reduced-rank estimator becomes 
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where pj [i] 



sg.,WELiA^ 



E/=i A* 'a;*[^]y[^]], the reduced-rank estimated correlation 
matrix is R,W = S'^J^j:i^,X'-'y[l]y''[l]SD,M and 
Dj\i] = Sg^H^j^i A*-'yWi^W- By minimizing (8) with 
respect to ij [i] we obtain 



f,H=B-^H DfWw,[z]-b[z] 



(11) 



where B[i] = ELiA'~'^[;]x^H and h[i\ 
'^i^i y^''x*[l]x.[l]. The associated sum of error squares 
(SES) is 

SES ^al- wf [i]Sg,^.[z]p[z] - p"[i]Sd,M^M 
+ w«[z]Sg^^.[z]RSz3,,Hw,[z] 
-ff[z]Df[i]Sz,,,[z]w,[z] (12) 

-w«[z]Sz5,,MD,[z]f,[z]+ffb[z] 
+ b[z]f,-[z]+ff[z]B[z]f,[z], 

where cr^ — E;=i A*~' N W P- Note that the expressions in (9), 
(10), and (11) are not closed-form solutions for Wj[z], Sdj[z], 
and f, [i] since they depend on each other and, thus, they have 
to be iterated with an initial guess to obtain a solution. The 
key strategy lies in the joint optimization of the estimators. 
The rank D must be set by the designer to ensure appropriate 
performance. The computational complexity of implementing 
(9), (10), and (11) is cubic with the number of elements 
in the estimators, namely, LNn, D, and Nt, respectively. 
In what follows, we introduce efficient RLS algorithms for 
implementing the estimators with a quadratic cost. 



B. Reduced-Rank Recursive Least Squares Algorithms 

In this part, we present RLS algorithms for efficiently 
implementing the LS design of the previous subsection. Firstly, 
let us define P^ = R-^\i], Qw,[i - 1] = Pw^M, Pd.j W = 
XPoit - 1] + x*[z]yWw^[z], P/.,H = AP/,,[z - 1] + 
x*[z]y[i]w^[i], and rewrite the expression in (9) as follows 



= SD,,[i-l]+k[z](x*Htf[z] 



(13) 



By defining the vector tj[i] = Qw [i]wj[i] and using the fact 
that y^[i -1] = y^[i - l]S D,j[i - 1] we arrive at 

-y^[z]Sz,,,[z-l]+tfHx^Hf,W), 
where the Kalman gain vector for the estimation of SDj[i] is 
A-ip[i-l]y[i] 



(14) 
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(15) 



and the update for the matrix P[i] employs the matrix inversion 
lemma 

P[z] = A-ip[z - 1] - A-^k[i]y^HP[i - 1], (16) 

the vector t^ [i] is updated as follows 

A-iQw,[«-l]w,[i-l] 



t,H = 



1 + A-iwf [z - l]Qw, [i - l]wj[z - 1] ' 



and the matrix inversion lemma is used to update Q^ [i] as 
described by 

Qw,M = A-iQwJi - 1] - \-Hj[i]wf[i - 1]. (18) 

Equations (13)-(18) constitute the part of the proposed RLS 
algorithms for estimating the projection matrix S£)j[i]. In 
order to develop the second part of the algorithm that estimates 
\Vj [i], let us consider the expression in (10) with its associated 
quantities, i.e., the matrix Rj[i] = X]I=i ^^ 'yWy'^W' '^^e 
vector Pj[i] — X];=i A* '^^ Wy[^] ^^'^ the matrix 'Dj[i] = 
J2Ui y~'y[l]y^"[li Let us define *j[i] = Rj^[i\ and rewrite 
Pj[i] as pj[i] = Xpj[i - 1] + a;*[i]yj[i] and T>j[i] as Dj[z] = 
Dj[i — 1] + y[i]x-f^[i]. We can write (10) as follows 

= w, [i-l]- kj [z]yf H w, [i-l]+ k, [i]x* H 

= w[z - 1] +k,[z](x*H -yf [i]w,[z - 1] +x«Hf,[z]). 

(19) 

By defining S^j [i] = Xj [i] — w;'^ [i — l]yj [i] + ff [i]x[i] we arrive 
at the proposed RLS algorithm for estimating Wj [i] 



where the Kalman gain vector is given by 

nr. A-i^,[z-l]y,[»] 

'^^ l + A-iyf[z]*,-[z-l]y,[z]' 



(21) 



and the update for the matrix inverse $ [i] employs the matrix 
inversion lemma 

*,-W = A-i*,-[i - 1] - A-ik,[z]yf W*,-[i - 1]. (22) 

The third part of the proposed algorithm estimates the feed- 
back filter section f,[i] and uses the expression in (11) in a 
similar way to the development of the estimation procedure 
of Wj[i]. Let us define P_B[i] = B~^[i] and rewrite h[i] as 
h[i] — Xh[i — 1] + a;*[i]x[i]. Then, let us express (11) in an 
alternative way as follows 

f,W = PBW(DfHw,H-bH) 

= f, [i - 1] - kB J- W {x* w - yf Ww, H + k" m [. - 1]) 

(23) 
where the Kalman gain vector ks [i] is given by 

A-iPB[i-l]x[i] 
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l + A-ii^HPB[z-l]x[i]^ 



(24) 



and the update for the matrix inverse P^ [i] employs the matrix 
inversion lemma 

Pb[z] = X-'PB[i - 1] - A-ikB[z]x^[z]PB[i - 1]. (25) 

Equations (19)-(25) constitute the second and the third part of 



(17) the proposed algorithm, which estimate w. 



and ij[i] 



The 
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(20) 



computational complexity of the proposed RLS algorithms 
is 0{D'^) for the estimation of Wj[i], OHLNr)"^) for the 
estimation of S£)j[i] and 0{N^) for the estimation of ij[i]- 
Because D « LNr, as will be explained in the next section, 
the overall complexity is in the same order of the conventional 
full-rank RLS algorithm {0{{LNfi)'^)) . 

VI. Simulations 

In this section, we assess and compare the bit error 
rate (BER) performance of the adaptive MIMO decision feed- 
back equalization schemes with different estimators designed 
according to the LS criterion, namely, the full-rank [6|, the 
reduced-rank MWF |[T9l when the turbo coding and decoding 
of f28l is removed, and the AVE [21 J techniques for the 
design of the receivers. The proposed adaptive reduced-rank 
MIMO DEE employs a reduced-rank estimator Wj[i] with 
D coefficients for the feedforward section, followed by a 
feedback structure estimator fj[i] with full-rank estimators 
that perform interference cancellation. Eor all simulations, we 
use the initial values Wj[0] = [l,0,...,0], f,- = Oat^xi, 
and S£)j[0] = [Ijj ^dx{jm-d)\^ 7 assume L = 5 as an 
upper bound, use 3-path channels spaced by one symbol and 
with relative powers taken from complex Gaussian random 
variables with zero mean and unit variance and QPSK modu- 
lation. The channel is static over one packet, we average the 
experiments over 100 runs and define the signal-to-noise ratio 



(SNR) as SNR = lOlogig^^^^, where a^ is the variance 
of the transmitted symbols and ct^ is the noise variance. The 
adaptive MIMO DFE employs iV^ = 4 and iVi,; = 8 in a 
spatial multiplexing configuration, leading to estimators at the 
receiver with LNr = 40 elements. The adaptive LS estimators 
of all methods are trained with 250 symbols and then switched 
to decision-directed mode. 

We consider the BER performance versus the rank D with 
optimized parameters (forgetting factors A — 0.998) for all 
schemes. The results in Fig. 4 indicate that the best rank for 
the proposed scheme is Z? = 4 (which will be used in the 
remaining experiments) and it is close to the optimal MMSE 
that assumes the knowledge of the channel and the noise 
variance. Our studies with systems with different sizes show 
that the optimal rank D does not vary significantly with the 
system size. It remains in a small range of values and does 
not scale with system size, which brings considerably faster 
convergence speed. However, It should also be remarked that 
the optimal rank D depends on the data record size and other 
parameters of the systems. In order to tackle this problem, 
we plan to devise in the future an adaptive rank selection 
algorithm that will automatically adjust the best rank and will 
be considered elsewhere. 
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Fig. 4. BER performance versus rank (D). 

The BER convergence performance versus number of re- 
ceived symbols is shown in Fig. 5. The results show that the 
proposed scheme has a significantly faster convergence perfor- 
mance and obtains good gains over the best known schemes. 
The BER performance versus the signal-to-noise ratio (SNR) 
is shown in Fig. 6. The plots show that the proposed reduced- 
rank MIMO equalizer and estimation algorithm have the best 
performance followed by the AVE, the MWF, and the full-rank 
estimator 

The advantages of the reduced-rank estimators are due to the 
reduced amount of training and the relatively short data record 
(packet size). Therefore, for packets with relatively small size, 
the faster training of reduced-rank LS estimators will lead to 
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Fig. 5. BER perfoiTnance versus number of received symbols. 



superior BER to conventional full-rank LS estimators. As the 
length of the packets is increased, the advantages of reduced- 
rank estimators become less pronounced for training purposes 
and so become the BER advantages over full-rank estimators. 
In comparison with the MWF and AVE reduced-rank schemes, 
the proposed scheme exploits the joint and iterative exchange 
of information between the projection matrix and the reduced- 
rank estimators, which leads to better performance. 
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Fig. 6. BER performance versus Ei,/No 



VII. Concluding Remarks 

This paper proposed an adaptive reduced-rank MIMO 
decision feedback equalization (DFE) structure based on joint 
iterative optimization of adaptive estimators. We described LS 
expressions and efficient RLS algorithms for the design of the 
proposed MIMO DFE. Simulations for a MIMO equalization 
application show that the proposed schemes outperforms the 



state-of-the-art reduced-rank and the conventional estimation 
algorithms at about the same complexity. Future work 
will consider the application of the proposed MIMO DFE 
equalizers and reduced-rank estimators to realistic MIMO 
channel models. 
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